REMARKS 



Entry of the amendments to the specification and claims, as amended by 
way of Annexes to the International Preliminary Examination Report for 
PCT/EP00/09183, before examination of the application in the U.S. National 
Phase is respectfully requested. 

If there are any questions regarding this Preliminary Amendment or this 
application in general, a telephone call to the undersigned would be appreciated 
since this should expedite the prosecution of the application for all concerned. 

If there are any questions regarding this Preliminary Amendment or the 
application in general, a telephone call to the undersigned would be appreciated 
since this should expedite the prosecution of the application for all concerned. 

If necessary to effect a timely response, this paper should be considered as 
a petition for an Extension of Time sufficient to effect a timely response, and 
please charge any deficiency in fees or credit any overpayments to Deposit 
Account No. 05-1323 (Docket #951/50488). 
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Title: SENSOR ARRANGEMENT 
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Commissioner for Patents 
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Sir: 




Attached is a Substitute Specification and a marked-up copy of the 
original specification. I certify that said substitute specification contains no new 
matter and includes the changes indicated in the marked-up copy of the original 
specification. 
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[MOTOR VEHICLE SENSOR ARRANGEMENT FOR DETECTING AN 
ENVIRONMENT] 

[The invention relates to a sensor arrangement for a 
motor vehicle for detecting an environment having at least one 
camera system. 

A sensor system of this type can be used, for example, 
for assisting the driver, thus for supporting an operator of a 
vehicle. It supplies information on the environment and can 
be used in the domain of lane tracking, for a warning in the 
case of a lane deviation, or in the domain of automatic 
vehicle guiding. 

In the case of such sensor systems, it is known to use 
so-called CCD cameras (CCD = charged coupled device) . 
However, it should be taken into account that the 
functionality of driving assistance systems is limited when 
the sensor is already subjected to limitations when detecting 
the environment. In the case of CCD cameras, it is known 
that, especially in darkness and in the event of a blinding by 
an external light source, these cameras have a limited 
functionality. In this case, with respect to a blinding in 
darkness, a superproport ional limitation should be taken into 
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account, specifically when the CCD camera is adjusted to the 

environmentally caused illumination level. In the event of 

encountering another vehicle driving with switched-on lights, 

the image information is even largely destroyed by the 

oncoming blinding sources. 

The use of infrared cameras in such sensor arrangements 
is also known (compare technical journal: CAR AND DRIVER , 
October 19 98 ) . Infrared cameras take a heat image of the 
driving environment. In the heat image, all contours and 
objects are based on thermal contrasts. However, the 
information which is important for the driving task or for the 
reaction of a driver assistance system cannot always be 
obtained from the heat image. 

It is an object of the present invention to further 
develop a sensor arrangement of the initially mentioned type 
such that a detection of the environment can take place 
essentially without any limitation of the functionality. 

This object is achieved by means of the characteristics 
indicated in Claim 1 . 

An essential idea of the invention is to use at least two 
camera systems with respectively different spectral operating 
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regions . 

According to a preferred embodiment, the sensor 
arrangement comprises a CCD-camera (charged coupled device) 
and a camera which operates in the infrared range. The 
infrared camera represents, for example, a meaningful 
supplementation of the sensor system (CCD) , which is visual 
here, beyond its detection limits in the extended area in 
front of the driving environment . 

According to another advantageous embodiment of the 
invention, the different camera systems are equipped with 
different focal distances. For example, the infrared camera 
takes over the detection of the environment in the remote 
range because it is suitable for day and night and is free of 
any blinding. Freedom from blinding means in this context 
that the individual pixels are not overmodulated by the 
headlights of oncoming vehicles. The image information is 
therefore retained although the environment is completely 
dark. The close range is detected by the CCD camera. In 
particular, the latter is adjusted such that it operates in a 
range which, when the vehicle lights are switched on, is 
illuminated by the front headlights. Because of the higher 
illumination level, this measure reduces the susceptibility of 
the CCD camera to blinding.] 
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SENSOR ARRANGEMENT 
BACKGROUND AND SUMMARY OF THE INVENTION 

The invention relates to a sensor arrangement for a motor 
vehicle for detecting an environment having at least two 
camera systems . 

A sensor system of this type can be used, for example, 
for assisting the driver, thus for supporting an operator of a 



V| vehicle. It supplies information on the environment and can 

yff; be used in the domain of lane tracking, for a warning in the 



case of a lane deviation, or in the domain of automat i c 



D vehicle guidance. 

Q In the case of such sensor systems, it is known to use 

so-called CCD cameras (CCD = charged coupled device) . 
However, it should be taken into account that the 
functionality of driving assistance systems is limited when 
the sensor is already subjected to limitations when detecting 
the environment. In the case of CCD cameras, it is known 
that, especially in darkness and in the event of blinding due 
to an external light source, these cameras have a limited 
functionality. In this case, with respect to a blinding light 
in darkness, a superproport ional limitation should be taken 
into account, specifically when the CCD camera is adjusted to 
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the environmentally caused illumination level. In the event 

another vehicle driving with switched-on lights is 

encountered, the image information is even largely destroyed 

by the oncoming blinding light sources. 

The use of infrared cameras in such sensor arrangements 

is also known (compare technical journal: CAR AND DRIVER, 

October 1998) . Infrared cameras obtain a heat image of the 

q driving environment. In the heat image, all contours and 

objects are based on thermal contrasts. However, the 

Of information which is important for the driving task or for the 

m ' ~ ^ " — - 

%| reaction of a driver assistance system cannot always be 
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p obtained from the heat image. 

O 
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O European patent document EP 0 454 516 Al describes an 

obstacle detection system having two video cameras, which 
generate images in the visible and in the infrared range. For 
generating images in the infrared range, CCD technology is 
used, for example. By means of a similar video camera, which 
can detect the entire spectrum, a differential signal is 
generated. This differential signal or differential image 
relates to the visual range, which is covered by the cameras 
and is based on the contrast of an object in this visual 
range. Japanese patent document JP-10 255019 also describes a 
system with a CCD camera, which generates a visible image from 
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the area in front of a vehicle. Furthermore, an infrared 
image is generated by an additional infrared camera. Based on 
the temperature information, a threshold for illuminated parts 
is generated, and an improved vehicle detection can take place 
on the basis of this threshold. 

It is an object of the present invention to further 
develop a sensor arrangement of the above-mentioned type such 
that the environment can be detected essentially without any 
limitation of the functionality. 

This object is achieved by a sensor arrangement for a 
motor vehicle for detecting the environment using at least two 
camera systems. Each camera system operates in a different 
spectral region. Each camera system is adjusted to a 
different focal distance. 

An essential idea of the invention is to use at least two 
camera systems with respectively different spectral operating 
regions . 

In this case , the different camera systems are equipped 
with different focal distances. For example, an infrared 
camera takes over the environmental detection in the remote 
range because it is suitable for day and night use and is free 
from the effects of blinding. Freedom from blinding means, in 
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this context, that the individual pixels are not overmodulated 

by the headlights of oncoming vehicles. The image information 

is therefore retained although the environment is completely 

dark. The close range is detected by the CCD camera. In 

particular, the CCD camera is adjusted such that it operates 

in a range which is illuminated by the front headlights when 

the vehicle headlights are switched on. Because of the higher 

illumination level, this measure reduces the susceptibility of 

the CCD camera to blinding effects. 

According to a preferred embodiment, the sensor 
arrangement comprises a CCD-camera (charged coupled device) 
and a camera which operates in the infrared range. The 
infrared camera represents, for example, a meaningful 
supplementation of the sensor system (CCD) , which is visual 
here, beyond its detection limits in the extended area in 
front of the driving environment. 

When using camera systems with different focal distances 
and [the] connected imaging scales, the driving environment^ 
as a whole, can be detected better [as a whole] in both the 
close and [in the] remote [range] ranges . 



Another advantage of using two camera systems with 
different spectral operating regions consists of determining 
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the [extinction of the atmosphere] atmospheric absorbance in 

the two spectral regions [by means of] via differential 

contrast evaluation. By comparing the [extinctions] 

atmospheric absorbances , conclusions can be drawn with respect 

to fog or haze, which has a different effect on the sensor 

range. Furthermore, in conjunction with a visual range model 

[filed] stored in a vehicle, a driver's visual range can be 

determined from the detected [extinctions] absorbances . This 

information, in turn, can be made available to the driver, or 

control parameters can be adjusted in the vehicle as a 

function of the determined driver's visual range. 

These and other advantageous embodiments are defined in 
the subclaims . 

BRIEF DESCRIPTION OF THE DRAWING 

The single figure will be explained in detail in the 
following and with reference to the single drawing. The 
figure of the single drawing is a schematic top view of a 
vehicle with a sensor system according to the invention 
arranged on the front of the vehicle . 

DETAILED DESCRIPTION OF THE DRAWING 

A vehicle 10 has two headlights 12^_ which illuminate a 
certain light range L during [the] operation. 

8 



Attorney Docket No. 951/50488 
Marked Up Substitute Specification 



Between the two front headlights 12, two cameras are 
arranged, specifically in this case, an infrared camera 16 and 
a CCD camera (CCD = charged coupled device) 14. Both cameras 
16 and 14 are aligned in the driving direction. The CCD 
camera is constructed and adjusted such that it essentially 
detects the range which is illuminated when the front 
headlights are switched on and therefore corresponds to the 
range L . 

In contrast, the infrared camera 16 detects the 
environment particularly in the remote range B. 

Both cameras 16, 14 are connected with a control and 
analyzing device 18. The control and analyzing device 18 
emits a signal to a display 20^_ which is arranged in the 
interior of the vehicle [interior in] within the driver's 
viewing range. The display 20 informs the driver of the 
environmental situation in the detected ranges. 

In addition, but not shown in the figure, the control and 
analyzing device 18 can supply its information also to other 
units in the vehicle, for example, to systems [which concern 
an] concerned with automatic vehicle guidance. 
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On the one hand, the control and analyzing device 18 
forwards the information transmitted by the cameras 16 and 14 
directly to the driver. It also carries out a differential 
contrast evaluation. As a result, the extinctions of the 
atmosphere can be determined in the two spectral regions. If 
a visual range model is also [filed] stored in the control and 
analyzing device 18, by way of the determined extinctions and 
by means of a differential contrast evaluation, a conclusion 
can also be drawn with respect to the driver's visual range. 

This visual range and/or these extinctions can then be 
utilized for adapting control parameters or for recommending a 
vehicle speed to the driver. 

However, for determining the extinction in the visible 
spectral region, another system, such as a LIDAR system may also 
be used. 



